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WAVELET-ENHANCED AUTOMATED FINGERPRINT 
IDENTIFICATION SYSTEM 

BACKGROUND OF THE INVENTION 
Field of The Invention 

The present invention relates to an improved method for characterizing, 
matching, and identifying biologically unique features such as fingerprints and irises. 
More specifically, it relates to methods for enhancement of digital images, fast 
directional convolution and fingerprint-oriented ridge thinning, matching and 
identification of fingerprints. 

Description of Related Art 

As our society is increasingly electronically-connected, automated personal 
authentication becomes more important than ever. Traditional techniques, such as 
those using personal identification numbers (PIN) or passwords, will not satisfy 
demanding security requirements as they are incapable of differentiating between an 
authorized person and an impostor. In fact, these techniques can only verify the 
correctness of the PIN input by a person, but not authenticate the true identity of the 
authorized person. 

To overcome this shortcoming in personal authentication, a number of biometric 
techniques have been investigated. Biometric authentication capitalizes on some 
unique bodily features or characteristics of a person, such as fingerprint, voice, hand 
geometry, face, palm, and iris pattern. Among these biometric features, automated 
fingerprint identification system (AFIS) has provided the most popular and successful 
solution, mainly due to the uniqueness of fingerprints and the historical legal aspect of 
fingerprinting for law enforcement. 
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A robust and efficient AFIS however, comes with many challenges. The AFIS 
must be able to differentiate two different fingerprints that may be seemingly identical to 
the untrained eye. The uniqueness of a fingerprint is characterized by the finely 
embedded details (called minutiae) of the print, and its overall ridge pattern and 
5 density. From a legal standpoint, under Singapore's criminal laws, two fingerprints that 
contain 16 or more reliably matching minutiae are registered as originating from the 
same finger of the same person. As a result, a successful AFIS must have strong 
discrimination power, robustness to certain degrees of deformation in the fingerprint, 
and fast (or even real-time) processing performance. 
10 Typically, AFIS includes features such as fingerprint image pre-enhancement, 

orientation filtering, ridge thinning, fingerprint registration and weighted matching score 
5 computation. The need for fingerprint image pre-enhancement arises because 
| regardless of the acquisition method and device (either from fingerprint cards, or from 
i'U fingerprint readers such as optical sensors, or more recently, semiconductor sensors) 
iS fingerprints are susceptible to various forms of distortion and noise, including blotches 
^ caused by the input environment, skin disease (cuts, and peeling skin), and skin 

l"= condition (either too wet among younger people, or too dry among elder people). As a 

pi i 

py result, fingerprint image enhancement is needed to suppress noise, improve contrast, 

^ and accentuate the predominant orientation information of the fingerprint. 

2Qi Orientational filters are generally used for image enhancement according to the 

local directions of fingerprint ridges, which are obtained from the orientation field of the 
fingerprint image. Prior art for pre-enhancing includes finding an accurate estimation of 
the orientation field using some advanced but complicated models and employing a 
global enhancement technique (e.g., M. Kass et al., "Analyzing Oriented Patterns", 

25 Comput. Vis. Graphics Image Process, 37, 362-385, 1987. N. Ratha et al., "Adaptive 
Flow Orientation Based Feature Extraction in Fingerprint Images", Pattern Recognition, 
28 (11), 1657-1672, 1995. Vizcaya et al., "A Nonlinear Orientation Model for Global 
Description of Fingerprints", Pattern Recognition, 29 (7), 1221-1231, 1996.). 
Nevertheless, these techniques are usually computationally expensive, and hence less 

30 suitable for most AFIS solutions that require real-time processing. Another class of pre- 
enhancement techniques first accentuates the orientation information and then 
estimates the orientation field. The most famous technique being the NIST's FFT- 
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based method (e.g., G. T. Candela, et al., "PCASYS-A Pattern-Level Classification 
Automation System For Fingerprints", National Institute of Standards and Technology, 
Visual Image Processing Group, Aug. 1995.), and also some other variants of the FFT- 
based method (e.g., Sherlock et al., "Fingerprint Enhancement by Directional Fourier 
5 Filtering, Proc." IEE Visual Image Signal Processing vol. 141 (2), 87-94, April 1994). 

After the pre-enhancement, orientation filtering is also commonly used to further 
enhance an input fingerprint image. Many filters have been designed for fingerprint 
image enhancement (e.g. Gorman et al., "An Approach To Fingerprint Filter Design", 
Pattern Recognition, Vol. 22 (1), 29-38, 1989; B. M. Mehtre, Fingerprint image analysis 
10 for automatic identification, Machine Vision and Applications, 6, 124-139, 1993; Kamei 
„ et al., "Image Filter Design For Fingerprint Enhancement", Proc. International 
Symposium on Computer Vision, 109-114, 1995; and Maio et al., "Direct Gray-Scale 
: £ Minutiae Detection In Fingerprints", IEEE Transactions on PAMI, Vol. 19, No. 1, 27-40, 
1 % January 1997), adopted a method to filter the image using a class of orientation filters, 
I3f and then derive the fingerprint minutiae from the gray-scale image directly. Such a 
method required intensive computations (e.g., Kasaei et al., "Fingerprint Feature 
Enhancement Using Block-Direction On Reconstructed Images", TENCON '97. IEEE 
fU Region 10 Annual Conference, Speech and Image Technologies for Computing and 
'A Telecommunications., Proceedings of IEEE, vol. 1, 303-306, 1997 attempted to avoid 
2& the use of a large class of filters.) To do so, the original image is first rotated to a 
particular direction to perform the orientation filtering, and then rotated back to the 
original direction. This rotation process introduces loss of accuracy due to the 
quantization noise of rotating a discrete image, which may subsequently result in the 
detection of false minutiae. 

25 Regarding ridge thinning, the prior art has consistently shown that the most 

effective and robust approach for fingerprint feature extraction is probably using 
binarization. With this approach, the fingerprint ridges are thinned into binary lines of 
width of only one pixel before the minutiae are extracted. Some prior art avoids 
binarization by performing the feature extraction process directly on the grayscale 

30 image (e.g., Maio et al., "Direct Gray-Scale Minutiae Detection In Fingerprints", IEEE 
Transactions on PAMI, Vol. 19, No. 1, 27-40, January 1997). Such an approach, 
however, has the drawbacks of missing minutiae and inaccurate minutiae position and 
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direction. Further, many powerful thinning algorithms have been developed for 
Chinese character recognitions but they are generally not applicable for thinning ridges 
in fingerprint images (e.g. Chen et al., "A Modified Fast Parallel Algorithm For Thinning 
Digital Patterns", Pattern Recognition Letters, 7, 99-106, 1988; R. W. Zhou, "A Novel 
5 Single-Pass Thinning Algorithm And An Effective Set Of Performance Criteria", Pattern 
Recognition Letters, 16, 1267-1275, 1995; and Zhang, "Redundancy Of Parallel 
Thinning", Pattern Recognition Letters, Vol. 18, 27-35, 1997). 

fjl ^ (S ) "l\ e conventional art includes many methods of fingerprint registration. Among 



them, minmia-based methods are the most popular approaches (e.g. Ratha et al., "A 
10 Real-Time Matching System For Large Fingerprint Databases", IEEE Trans. PAMI, 18 
,^ (8), 799-813, Aug., 1996). Such methods make use of the positional and orientational 
;;Q information of eafch minutia (e.g. Ratha et al., "A Real-Time Matching System For Large 
J Fingerprint Databases", IEEE Trans. PAMI, 18 (8), 799-813, Aug., 1996; Hrechak et al., 
| "Automated Fingerprint Recognition Using Structural Matching", Pattern Recognition, 
if I 23(8), 893-904, 199o\wahab et al., "Novel Approach To Automated Fingerprint 
» Recognition", Proc. lEEyisual Image Signal Processing, 145(3), 160-166, 1998; and 
{'rj Chang et al., "Fast AlgoritVn For Point Pattern Matching: Invariant To Translations, 
[U Rotations And Scale Change^, Pattern Recognition, 30(2) 31 1-320, 1997), or possibly 
l;5 together with a segment of rictae associated with the minutia (e.g. Jain et al., "An 
28 Identity-Authentication System L^ing Fingerprint", Proc. IEEE, 85(9), 1365-1388, 
1997). Some minutia-based methods implement registration based on only a few 
minutiae. These methods are usually simple and fast in computation. However, since 
these methods depend mainly on the locaSJnformation of a fingerprint, they cannot well 
handle the influence of fingerprint deformation and may provide an unsatisfied 
25 registration. \ 

To overcome this problem, some other methods that exploit the global features 
of the prints have been developed. A typical example of such methods is to use the 
generalized Hough transform (Ratha et al., "A Real-Time Matching System For Large 
Fingerprint Databases", IEEE Trans. PAMI, 18 (8), 799-813, Aug., 1996) to perform the 
30 registration. This approach allows consideration of the contribution of all the detected 
minutiae in the prints, and is efficient in computation. 
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In the weighted matching score computation, the matching score is the final 
numerical figure that determines if the input print belongs to an authorized person by 
comparing the score against a predetermined security threshold value. Conventionally, 
the most used formula for matching score computation is given by the ratio of the 
5 number of matched minutiae to the product of the numbers of the input and template 
minutiae. For example, suppose that D minutiae are found to be matching for prints P 

and Q. A matching score is then determined using the equation S = J , where M 

V MN 

and N are the number of the detected minutiae of P and O respectively. This way of 
computing the matching score is simple and has been accepted as reasonably 
1Q accurate. 

However, such a matching score may be unreliable and inconsistent with 
: J respect to a predetermined threshold. There are situations where two non-matching 
5 prints can have a relatively high count of matching minutia, as compared with a pair of 

□ matching prints. This results in relatively close matching scores, which also means that 

f.n 

the discrimination power to separate between matching and non-matching prints can 
j;* be poor for a chosen security threshold value. 

i U Tniaconventional art includes many methods of fingerprint registration. Among 

;;5 them, minutia^ased methods are the most popular approaches (e.g. Ratha et al., "A 
i,J Real-Time Matchirig^ystem For Large Fingerprint Databases", IEEE Tans. PAMI, 18 

20 (8), 799-813, Aug., 199&)KSuch methods make use of the positional and orientational 
information of each minutia (e^Ratha et al., "A Real-Time Matching System For Large 
Fingerprint Databases", IEEE Tans>RM/ll, 18 (8), 799-813, Aug., 1996; Hrechak et al., 
"Automated Fingerprint Recognition Usin^Structural Matching", Pattern Recognition, 
23(8), 893-904, 1990; Wahab et al., "NoveN^oproach To Automated Fingerprint 

25 Recognition", Proc. IEE Visual Image Signal Proces&qg, 145(3), 160-166, 1998; and 
Chang et al., "Fast Algorithm For Point Pattern Matchin^xlnvariant To Translations, 
Rotations And Scale Changes", Pattern Recognition, 30(2) 31 1^S20, 1997), or possibly 
together with a segment of ridge associated with the minutia (e^. Jain et al., "An 
Identity-Authentication System Using Fingerprint", Proc. IEEE, 85(^i 1 365-1 388, 

30 1997). Some minutia-based methods implement registration based on cn^ly a few 
minutiae. These methods are usually simple and fast in computation. HowevehvSince 
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tnese methods depend mainly on the local information of a fingerprint, they cannot 
handle the influence of fingerprint deformation and may provide an unsatisfied 
registration. 

fo overcome this problem, some other methods that exploit the global features 
of the prints have been developed. A typical example of such methods is to use the 
generalize^ Hough transform (Ratha et al., "A Real-Time Matching System For Large 
Fingerprint Databases", IEEE Tans. PAMI, 18 (8), 799-813, Aug., 1996) to perform the 
registration. This approach allows consideration of the contribution of all the minutiae in 
the prints, and re efficient in computation. 
10 In the weighted matching score computation, the matching score is the final 

. s=n numerical figure that determines if the input print belongs to an authorized person by 
iQ comparing the scora against a predetermined security threshold value. Conventionally, 
!3 p the most used formula for matching score computation is given by the ratio of the 
S number of matched minutiae to the product of the numbers of the input and template 
<I minutiae. For example, suppose that D minutiae are found to be matching for prints P 

' D 2 

and Q. A matching score & determined using the equation S = J . This way of 

m > \ V MN 

[U computing the matching scoi^ is simple and has been accepted as reasonably 
□ accurate. 

However, such a matching score may be unreliable and inconsistent with 
20 respect to a predetermined threshold. There are situations where two non-matching 
prints can have a relatively high counrof matching minutia, as compared with a pair of 
matching prints. This results in relativelyVlose matching scores, which also means that 
the discrimination power to separate between matching and non-matching prints can 
be poor for a chosen security threshold value 
25 Therefore a demand exists to provide a method or a system for characterizing, 

matching and identifying fingerprints or other biologically unique features, which 
improves on the above mentioned problems of AFIS regarding image data pre- 
enhancement, orientation filtering, ridge thinning, fingerprint registration and weighted 
matching score computation. 

30 
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It is the object of the present invention to provide a method or a system for 
characterizing, matching and identifying fingerprints or other biologically unique 
features, which improves on the AFIS and includes image data pre-enhancement, 
orientation filtering, ridge thinning, fingerprint registration and weighted matching score 
5 computation. 

These advantages are achieved by a biological data matching system 
including an image reader, which acquires personal biological data; a template of 
biological data; a pre-enhancing unit adapted to pre-enhance the personal biological 
image data according to local areas of contrast; an image smoothing and enhancement 

10 filter for enhancing said pre-enhanced image data; an orientation data thinner for 
removing false data in the personal biological image data; a registration unit for aligning 

; Q the personal biological image data with the template image data and a matching score 
| unit for determining if the biological data matches the template print. Further, the 

r 2 personal biological data may be a fingerprint, iris, voice, hand geometry, face or palm 

1S pattern, etc. 

^ The advantages are further achieved by a finger print minutiae extraction 

|;f ; method including acquiring fingerprint image data; partitioning the fingerprint image 
TU data into at least one data block corresponding to a local area of the image; generating 

a histogram function of a contrast level of said image data corresponding to said data 
2§ blocks; and performing a histogram transformation of the histogram function. Further, 

the histogram transformation is adapted to the contrast level of the local area of the 

fingerprint image data and pre-enhanced fingerprint image data is generated with local 

enhancement. 

Further scope of applicability of the present invention will become 
25 apparent from the detailed description given hereinafter. However, it should be 
understood that the detailed description and specific examples, while indicating 
preferred embodiments of the invention, are given by way of illustration only, since 
various changes and modifications within the spirit and scope of the invention will 
become apparent to those skilled in the art from this detailed description. 

30 

BRIEF DESCRIPTION OF THE DRAWINGS 
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The present invention will become more fully understood from the detailed 
description given hereinbelow and the accompanying drawings which are given by way 
of illustration only, and thus are not limitative of the present invention, and wherein: 

Figure 1 illustrates a flow chart of the AFIS according to the present invention; 
5 Figure 2 depicts an 8-neighborhood of pixel P; 

Figure 3 depicts a table of offset coordinates of directional convolution for filter 
with length 7 and 16 possible directions; 

Figure 4 depicts a lookup table (LUTi) for fingerprint-oriented thinning; and 

Figure 5 depicts a lookup table (LUT 2 ) for fingerprint-oriented thinning. 

10 DETAILED DESCRIPTION OF THE INVENTION 

fA /bSo Tre-iQvention is a method and system for performing AFIS with various features 

2 that contribute ra^a^ignificant performance improvement to two of the most important 
ru aspects of an AFIS: c^ffiqiency (fast processing), and reliability (accuracy and 
q robustness to variations in input"1 : Hqgerprints). In particular, these features include a 
1 s § histogram pre-enhancement method, fe^aqioothing and enhancement method for 
!<* fingerprint images, a fingerprint-oriented thinning melhods, a modified Hough transform 
rn for fingerprint registration, and an improved matching soti^ computation method. 
fU It is noted that while the specification discusses the invention in relation to 

Q fingerprints, the invention is not limited to an application for fingerprints and may also 
20 be used for other data image processing and matching such as iris, voice, hand 
geometry, face and palm patterns. 
{A fit}^ As^H^strated in the Figure 1 , the system includes four modules: a preprocessing 

module 1, an ehtaancement module 2, a feature extraction module 3, and a matching 
module 4. The prefr^qcessing module 1 pre-enhances an input fingerprint image to 
25 remove some noise cau^ecjby the fingerprint acquisition device or method 5 and 
removes the dominant ridge dircstjons. The enhancement module 2 further removes 
noise and accentuates the desired matures of the input fingerprint image so as to 
provide a higher quality image for the otikn processing units. The feature extraction 
module 3 extracts all the fingerprint minutiae tn&tare unique and consistent features of 
30 an individual, and provides the basis for classificatibn and identification. The matching 
module 4, implements fingerprint minutiae matching ahd fingerprint identification and 
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determines^tiether or not a fingerprint matches a template fingerprint. The template 
fingerprint may be^tqred in a database 6. 

Tffe preprocessing module 1 includes a histogram transformer 10, dominant ridge 
directiorvestimator 11 and coarse segmentation unit 12. The histogram transformer 10 
5 receives finder print images from a finger print sensor/reader 5 or other data scanner or 
acquirer well known in the art. The dominant ridge direction estimator 11 and coarse 
segmentation de^ce 12 receive the transformed fingerprint image data. The coarse 
segmentation 12 outputs the processed coarse segmentation image data to the 
dominant ridge directon estimator 11 which performs the estimation using the 
10 processed coarse segmentation image data and the transformed fingerprint image 
data. 

The enhancement module 2 includes a fine segmentation unit 20, an orientation 
2 smoothing and enhancing unit 21 and an enhanced fingerprint image unit 22. The fine 
H segmentation unit 20 and orientation smoothing and enhancing unit 21 receive the 
tS image data from the dominant ridge direction estimator 1 1 and process the image data 
" ! in parallel. Both the fine segmentation unit 20 and orientation smoothing and 
;;f; enhancing unit 21 deliver processed data to the enhanced fingerprint image unit 22 
ry which uses the processed data to further enhance the image data. 
;~ The feature extraction module 3 includes a binalizing grayscale image unit 31, a 

29 fingerprint oriented thinning unit 32, and a minutiae extractor 33. The binalizing 
grayscale image unit 31 receives enhanced image data from the enhancement module 
2 and outputs binalized grayscale image data to the fingerprint oriented thinning unit 
32. The fingerprint oriented thinning unit 32 outputs thinned image data to the minutiae 
extractor 33 for processing. 

25 The matching module includes a fingerprint registration unit 41 and a matching 

score computation unit 42. The fingerprint registration unit 41 receives minutia data 
from the feature extraction module 3 and aligns the current fingerprint against each of 
the template fingerprints in the database 6. The matching score computation unit 42 
provides a numerical figure that represents the degree of matching between the current 

30 fingerprint and a template fingerprint in the database 6. The AFIS stores the template 
fingerprints and personal information of each person as a record in the database 6. 
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During verification or identification, the unique features of a person's fingerprint are 
extracted, and searched against the template fingerprints in the database 6. 

The histogram transform 10 of the preprocessing module 1 performs the 
pre-enhancement histogram transformation of the finger print image data using a 
5 simple but effective method including specially designed histograms tailored to the 
statistical information of fingerprint images. Unlike conventional histogram equalization 
methods that use constant functions, a special function is used for global/local 
enhancement and adapts automatically to the histogram characteristics of each input 
fingerprint. The method can be implemented fast enough for on-line processing, and 

1 0 also gives better performance than approaches in existing systems such as in Jain et 
al., "On-Line Fingerprint Verification", IEEE Trans. On Pattern Recognition and 

;S Machine Intelligence, 19 (4), 302-314, 1997. 

| The histogram transform 10 performs the following pre-enhancement functions. 

r y The fingerprint image is partitioned into image blocks of size Sb x St>. A block may be 
i!G5 formed that encompasses the entire fingerprint image or several blocks may be formed 
I rl with each block encompassing only portions of the image. Histograms of pixel intensity 
on a pixel by pixel basis are generated for each block. The corresponding histogram 
ry function is also constructed for each block. Assuming that the histogram function for an 
!=i* image block is g(x), the histogram transformer 10 maps histogram function of the image 
20 to a specific function according to the following mapping 

x h> argmin{^ | [g(t)dt < f(y)} 

where f(x) is target histogram function. The target histogram function has low 
value at the mid-point and has a high value at the endpoint of the interval. An example 

of such function is / (x) = N b x (x - ^) 2 / 1" (x - ^-) 2 dx, 

25 where M is the maximum value of possible intensity of pixel, such as 256 for 8- 

bit per pixel fingerprint images, and N b is the number of pixels in the image/block, such 
as 256 for block of size 16x16. Of course, the function f(x) can be optimized to some 

other suitable functions of similar type. 

Such a histogram transformation can be either global for the entire image (by 
30 setting the block to be the entire image), or local for a portion of the image (using 
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smaller blocks). When several blocks that are smaller than the image are used to 
partition the fingerprint image data, a localization property of the transformation 
operator exists. That is the histograms, corresponding histogram functions and 
transformations are generated for a sub-section or local area of the fingerprint image. 
5 Thus, the pre-enhancement can adapt to different contrast levels at different parts of 
the image and areas of differing contrast levels may be processed more specifically. 
This subsequently allows better coarse segmentation of the image according to the 
mean and variance values of each image block. Also, image blocks that contain actual 
fingerprint ridges but are still blurred after the processing are marked as background 
10 blocks, which are ignored so as to accelerate the pre-processing module. 



yJ segmentation on every Sb x Sb block. The coarse segmentation unit 12 identifies a 
block as a foreground block or a background block by comparing the mean value and 
! S variance of the block with predetermined threshold and generates tags of every block. 



a The dominant ridge direction estimator 1 1 in preprocessing module 1 performs 

j!n dominant ridge direction estimation according to an algorithm and using the tags 
i' a y generated by coarse segmentation unit 12 and the pre-enhanced image data 
i:5 generated by histogram transform 10. Only blocks with a tag value of 1 are processed 
&b in the dominant ridge direction estimator 1 1 . The output of preprocessing module 1 is 
the index of one of 16 discrete directions generated by dominant ridge direction 
estimator 12 and output image generated by histogram transform 10. An example of a 
dominant ridge estimation algorithm is that used in K. Jain, and H. Lin, "On-Line 
Fingerprint Verification, IEEE Trans. On Pattern Recognition And Machine Intelligence", 
25 19 (4), 302-314, 1997. Other suitable algorithms and processing methods may also be 
used. 



unit of enhancement module 2 analyzes the smoothness of discrete direction of each 
foreground block and the corresponding 8-neighbourhood blocks of the foreground 
30 block. The 8 neighbors of the foreground block are arranged the as same as the pixels 
are depicted in Figure 2. If the difference of discrete direction of a foreground block 
between the average direction of 8-neighbor blocks is greater than a predetermined 



The coarse segmentation 12 of preprocessing module 1 performs coarse 



The tags have values 1 for a foreground block or 0 for a background block. 



Using the output of the pre-processing module 1 , the fine segmentation 
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threshold, the foreground block is segmented as a background block and the tag of this 
block is assigned to 0. 

he orientation smoothing and enhancing unit 21 of the enhancement module 2 
performs orientation filtering using two convolution processes. A smoothing process 
5 and an enhancing process is imposed on every foreground block image. First, the 
smoothing convolbtjon for all foreground blocks occurs. Then, the foreground blocks 
are enhanced. The convolution is a directional convolution for a 2-dimensional digital 
image, and includes a convolution of the filter (low pass filter for smoothing and high 
pass filter for enhancing, respectively) with the current block image data by a directional 
10 filter. The convolution is implemeiqted by imposing on every pixel within the block the 
following algorithm: 

: fj A/ 

S(h j,k) = Y J f(t+ y offset (0, j + * offset WO 

r y where g(i,j,k) is the output of image intensity at location (i,j); k is index of the 

□ dominant direction a k =£x;r/16of current block kh: smoothing processing and k is 
15 index of the perpendicular direction of dominant directiortxrf current block for enhancing 



i y 

ru 



processing, and h(l) is the low pass filter with 7-tap for smoothing convolution and the 

high pass filter with 7-tap for enhancing convolution, respectively. The offset 
ru \ 
□ coordinates (Xoffset, y 0 ffset) corresponding to discrete direction a k are listed in Figure 3.. 

• sax 

The enhanced fingerprint image unit 22 sets all pixels of background block 
20 marked by fine segmentation unit 20 to 0 the output of orientation smoothing and 
enhancing unit 21 and produces an enhanced fingerprint image. 

In the feature extraction module 3, the binalizing grayscale image unit 31 and 
minutiae extractor 33 are standard algorithms used in image processing (e.g. S. 
Kasaei, and M. Deriche, "Fingerprint Feature Enhancement Using Block-Direction On 
25 Reconstructed Images", TENCON '97. IEEE Region 10 Annual Conference. Speech 
and Image Technologies for Computing and Telecommunications., Proceedings of 
IEEE, vol. 1, 303— 306, 1997. 

The input and output of binalizing grayscale image unit 31 are grayscale image 
and a black/white image, respectively. The input of minutiae extractor 33 is a 
30 black/white image with one-pixel width curve/ridge and the output of minutiae extractor 
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33 is a set of minutiae information in which there are attributes of one minutiae 
including the coordinate of minutiae and the direction of this minutiae. 

* The fingerprint oriented thinning unit 32 of the feature extraction module 
3 processes the output of the binalizing grayscale image unit 31 giving special 
5 consideration to the unique properties of fingerprint ridges and minutiae. Unlike 
character recognition applications, a critical problem in fingerprint recognition 
application is the formation of false connections that incorrectly link up two adjacent 
disjoint ridges. These false connections need to be removed, as they will subsequently 
introduce false minutia and impair the accuracy of the matching module 4. The 
10 invention incorporates a set of rules that redefine the behavior of the thinning algorithm 
such that there are much fewer false connections after the thinning process. 

The fingerprint oriented thinning unit 32 processes fingerprint data by using an 
,C algorithm to apply LU^ and LUT2, as shown in Figures 4 and 5, respectively, to each 
J pixel foreground pixel P. An example of an algorithm that may be used is found in 
i§ Chen et al., "A Modified Fast Parallel Algorithms For Thinning Digital Patterns", Pattern 

Recognition Letters, 7, 99-106, 1988. Other suitable algorithms may also be used. 
j s y The LUTs are formed using the following rules. Let A(P) be the number of 0-1 

j 3 J=; (binary transition) patterns in the order set P 1t P 2 , P3, P4, Ps, P6, P7. Ps, Pi, where P s , 

□ i=1 8, are the 8-neighbors of the foreground pixel P in a clockwise direction (see 

2(3 Figure 2), and B(P) is the number of nonzero neighbors of P. The following rules are 
applied. 

For 2 < B(P) < 7, we choose either 

1. A(P)=1, 

If Pi*P 3 *P 5 =0 and P 3 *P 5 *P 7 =0 then LUT^P^O; 
25 If P 1 *P 3 *P 7 =0 and P 1 *P 5 *P 7 =0 then LUT 2 (P)=0; or 

2. A(P)=2, 

If P 1 *P 3 =1 and P 5 +P 6 + P7=0 then LUTi(P)=0; 
If P 3 *P 5 =1 and Pi+P 7 +P 8 =0 then LUTi(P)=0; 
If p.,*p 7 =i and P 3 +P 4 +P 5 =0 then LUT 2 (P)=0; 
30 If P 5 *P 7 =1 and Pi+P 2 +P 3 =0 then LUT 2 (P)=0. 




The following new rules are incorporated into the new algorithm: 
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If Pi*P 7 *P 8 =1 and P 2 +P 6 >0 and P 3 +P 5 =0 then LUTi(P)=0; 
If P 5 *P 6 *P7=1 and P 4 +P 8 >0 and Pi+P 3 =0 then LUTi(P)=0; 
If Pi*P 2 *P 3 =1 and P 4 +P 8 >0 and P 5 +P 7 =0 then LUT 2 (P)=0; and 
If P 3 *P 4 *P5=1 and P 2 +P 6 >0 and Pi+P 7 =0 then LUT 2 (P)=0. 
5 The algorithms listed above in rule groups 1 and 2 can be found in Chen 

et al., "A Modified Fast Parallel Algorithm For Thinning Digital Patterns", Pattern 
Recognition Letters, 7, 99-106, 1988. Rule groups 1 and 3 are designed for thinning of 
character images while the new rules are designed for the thinning of biological data 
such as fingerprints. The set of new rules not only reduces the number of false 
10 connections, but also significantly cuts down the number of computations because 
during each iteration, the fingerprint oriented thinning unit 32 is capable of removing 
more pixels than other conventional methods. 
: £ The fingerprint oriented thinning unit 32 performs the following iteration on each 

■ ^ foreground pixel P. If the result of the lookup table, LUTi, as shown in Figure 4 is equal 
1;5 to zero, then the pixel P is removed by classifying it as background. The same 
procedure is then repeated using another lookup table, LUT 2 , as shown in Figure 5. 
i!f| This process is iterated on all foreground pixels until no pixels can be removed. 
rU The fingerprint registration unit 41 in the matching module 4 has significant 

affect on the performance of the entire AFIS system. During registration, the current 
2§ fingerprint is aligned against each template fingerprint in the database 6. The database 
6 may contain one or more than one templates. The invention performs fingerprint 
image registration using a resolution-enhanced generalized Hough transform. 

The generalized Hough transform is defined as follows (Ratha et al., "A 
Real-Time Matching System For Large Fingerprint Databases", IEEE Trans. PAMI, 18 
25 (8), 799-813, Aug., 1996): Let P and Q denote the minutia data sets extracted from an 
input fingerprint image and a template, respectively. Usually, P and Q can be 
organized as P = {(p l x , p l y9 a x \ (pf , p? 9 a M )} , and Q = {(q l x ,q l y9 

(q N x iQy , fi N )} > where (p x ,p y ,a') and (q J x ,q J y ,/? J ) are the features, i.e., the position 

and orientation associated with the /th minutia in P and the jth minutia in O, M and N 
30 are the number of the detected minutiae of P and O, respectively. The generalized 
Hough transform aligns P against Q by determining the translation parameters Ax in x 
axis and Ay in y axis, and the rotation parameter 0. It first discretizes the parameter 
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space into a lattice with 0e {<?,,..., 0,}, Ax e {Ax,, Ax,}, and Aye {Ay,,..., Ay^}. 
Each combination {Ax,, Ay y , 0 k ) is called a lattice bin. Then, for each minutia in P and 
every minutia in Q, it computes the transformation parameters {Ax, Ay,0) by 

(1) 



0 = J3 J 


-a' 


and 
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cos/9 -sin# V ~ ,>l 



sin 0 cos 0 



(2) 



APyJ 

and quantizes them into the above mentioned lattice. Each set of the quantized 
parameters obtained is said to be one 'evidence' of the corresponding lattice bin. The 
„ generalized Hough transform counts the number of evidences for each bin in the lattice 
10. and finally specifies the parameters of the lattice bin that corresponds to the maximum 
:! p number of evidences as the parameters for the (actual) registration. 

Wjnile the generalized Hough transform is efficient in computation and works 
H well in mahy cases, even on partial information of prints, it suffers from an inherent 
problem that ihsmts its performance. To make the registration accurate, it is desirable to 
lip use small size oKjattice bins. This, however, will result in a low maximum evidence 
[U count, which meansthat the alignment will be less reliable. On the contrary, increasing 
i;5 the lattice bin size witlvjead to poor spatial resolution and thereby low registration 
isJ accuracy. 

In the inventive AFIS, the standard generalized Hough transform is modified 
20 such that it can simultaneously overcome the above-mentioned problem, and yet retain 
the major advantages of the Hough transform. The modification is as follows. 1) A 
sufficiently large lattice bin size is chosen experimentally to ensure that enough 
evidences can be accumulated within a bin. 2) The number of evidences for each of 
the bins of the lattice is counted as is done in the generalized Hough transform. 3) The 
25 lattice is shifted in the x and y directions at a predetermined step size, and further, the 
number of evidences for each bin of the shifted lattice is counted. The shifting and 
counting processes are repeated and stops until a bin at the final position of shifting is 
overlapped completely with its diagonal neighbor at the position before the shifting 
process. Note that shifting the lattice essentially partitions each bin into blocks. In a 
30 direction, each block has the same size as the shift step. 4) For each shift, each block 
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is assigned a number equal to the counts of evidence of the bin in which the block is 
contained. 5) All such numbers of the overlapped blocks for each block position are 
summed, and the transform parameters are specified as the position parameters of the 
block that corresponds to the maximum sum. 
5 Testing was performed for the various bin and shifting step sizes with as many 

prints as possible so as to determine the best translation and rotation parameters. 
Currently, the bin size is Ax = 16pix, Ay = 16pix, and 9- 10°. The step size of shifting is 
4pix in both the x and y directions. These values however may be changed because 
they are relevant to the fingerprint sensor used in a system. 
10 The advantage of this approach, as compared with the ordinary generalized 

,^ Hough transform, is that the registration accuracy and reliability now are determined by 
:Q shift step and bin size, respectively, which overcomes the shortcomings mentioned 
,p previously. The accuracy of registration is increased by decreasing the shift step size 
2 while simultaneously maintaining the reliability. Although this approach adds some 
1J§ computations, application tests verified that it is suitable for real-time applications. 
J The matching score computation unit 42 provides the final numerical 

\Z figure that determines if the input print belongs to an authorized person by comparing 
[U the score against a predetermined security threshold value. To overcome the 
□ problems in the traditional art, the invention incorporates a method of computing a 
2& matching score that is more reliable and has a much improved discrimination capability. 
This method exploits the features of the above approach for fingerprint registration 
using shifted lattices. It was found that although the number of matched minutia 
between two non-matching prints can be relatively high, the distribution of the evidence 
counts over the lattices can be largely different from that of two matching prints. For 
25 non-matching prints, the maximum value of evidence counts is low while the variance 
of the parameters of the lattice bins corresponding to the maximum evidence counts is 
large (usually more than one bins have the maximum evidence counts). In addition to 
using the number of matched minutia, the method takes into consideration these two 
factors in the computation of the final matching score. 
30 Sigmoid nonlinear functions are used to weigh the contribution of each of the 

three factors. 
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(3) 



where m is the maximum value of evidence counts, v is the variance of the 
parameters of the lattice bins corresponding to the maximum evidence counts, D is the 
number of the matched minutiae, M and N are the number of the detected minutiae in 
5 the current and template prints, and w m , w v , w D , m 0 , v 0 and D 0 are prespecified 

parameters determined by experiments, respectively. <x(o) = 1 is the 

1 + exp(- (o)) 

sigmoid function. 

Experimental tests confirmed that this formulation provides much better 
□ discrimination between matched and unmatched pairs than the traditional computation 
l£j of matching score. Also, this improvement could be achieved with almost no extra 
;;f; computations. 

;! p Experimental tests confirmed that this formulation provides much better 

discriminationbqtween matched and unmatched pairs than the traditional computation 
of matching score>\Also, this improvement could be achieved with almost no extra 

1 S S computations. 

Urj The declared AFIS system can be used for both one-to-one matching as well as 

j ;3 for one-to-many matching against database prints of authorized persons. . As an 
example of the matching speed, the correct identification of an individual from a 
database of about 100 persons will take less than 1.5 seconds, while a one-to-one 

20 matching will take only about 0.4 second (using a Pentium Pro 200 processor). The 
system is also very robust to variations in input fingerprints. For example, the system 
can still correctly authenticate a person with an input fingerprint that is of low captured 
quality, and with some portions of the print removed. 

Some applications of the invention include but are not limited to the 

25 following: secured transactions (e.g., using credit card for Internet banking and 
retailing, and for user authentication in automated teller machines); secured access 
control (e.g., lift and door access in buildings, and computer or network access without 
using passwords or cards); secured database systems (e.g., medical database of 
patients, nation-wide database for immigration and identification control; time-stamping 



ocketNo.: 1781 -01 81 P 

18 



database of workers in a company, and logistic database for controlling equipment 
checkout, or for monitoring movements of prisoners). 

The invention being thus described, it will be obvious that the same may be 
varied in many ways. Such variations are not to be regarded as a departure from the 
spirit and scope of the invention, and all such modifications as would be obvious to one 
skilled in the art are intended to be included within the scope of the following claims. 



